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In  Conclusion ... 


•  Cognitive  models  are  an  instructional 
imperative  ...  and  no  longer  an  economic 
impossibility. 

•  Cognitive  models  have  been  used  in 
technology-based  instruction  from  the 
beginning. 

•  Cognitive  models  are  needed  for  simulation 
used  to  train.  Open  questions  remain. 


Two  Cultures, 

Divided  by  a  Common  Language 


Simulationists  ►  Trainers 


Collectives/Units 

Individuals/Teams 

Exercises 

Programs  of 
Instruction 

Full  Fidelity 

Selective  Fidelity 

Big  Simulation 

Small  Simulation 

These  are  complementary  not  competing  cultures. 


Learning  Content 


How  Trainers  Think:  Learning  Objectives 


Meta- 

Cognition 


Adaptive 

Procedures 

Concepts 

Simple 

Procedures 

Facts 


Remember  Understand  Apply  Analyze  Evaluate 

Learning  Objectives 


Create 


(Framework  courtesy  of  Anderson  &  Krathwohl,  2001) 


On  teaching:  From  Yue-zheng  (4th  C.  BC) 
to  Patrick  Suppes  to  Jerome  Bruner  to  ... 


“The  principal  consequence  of  ...  individual 
differences  is  that  every  general  law  of 
teaching  has  to  be  applied  with  consideration 
of  the  particular  person, ...  responses  ...  to 
any  stimulus  ...  will  vary  with  individual 
capacities,  interests,  and  previous 
experience.” 

(E.  L.  Thorndike,  1906,  Principles  of  Teaching) 


Q&A:  Why  Bother  with  Cognitive  Models? 


c 


Q:  Why  do  we  use  cognitive  models  in  instruction? 

A:  To  tailor  instruction  to  learners. 

Q:  Why  do  we  want  to  tailor  instruction  to  learners? 

A:  Because  it  is  very  efficient. 

Q:  Why  do  we  want  efficient  training? 

A:  Because  it  contributes  to  productivity  and 

effectiveness  in  operations  -  more  can  be  done  with 
fewer  people  and  fewer  resources. 


On  learning:  From  Aristotle  (4th  C.  BCE) 
to  William  James  to  Norbert  Weiner  to  ... 


“Whilst  part  of  what  we  perceive  comes 
through  our  senses  from  the  object  before 
us,  another  part  (and  it  may  be  the  larger 
part)  always  comes  out  of  our  mind.” 

(William  James,  1890  --  General  Law  of 
Perception  in  Principles  of  Psychology) 


Learning  Content 


Cognitive  Models  in  Education  &  Training 


Meta- 
Cognition 

Adaptive 
Procedures 

Concepts 

Simple 
Procedures 

Facts 

Remember  Understand  Apply  Analyze  Evaluate  Create 

Learning  Objectives 

(Framework  courtesy  of  Anderson  &  Krathwohl,  2001) 


Learning  environments.  Simulations 
that  are  'situated'  and  'authentic  -- 
used  to  compress  practical 
experience.  Focus  on  learner 
productivity  -  rarely  measured. 

Explicit  and  implicit  cognitive 

models.  Instruction  we've 
known  how  to  create  since  the 
1960s.  Focus  on  instructional 
productivity -often  measured. 

About  Training 


Cognitive  models  are  an  instructional 
imperative  ...  and  no  longer  an  economic 
impossibility. 


#  Students 


The  Tutorial  Imperative 


Achievement 


Adapted  From:  Bloom,  B.S.  The  Two  Sigma  Problem:  The  Search  for  Methods  of  Group 
Instruction  as  Effective  as  One-to-One  Tutoring.  Educational  Researcher.  13,  4-16  (1984) 


Why  Is  Tutoring  So  Effective? 


□  Individualization  of 

-  Sequence, 

-  Content, 

-  Style, 

-  Difficulty, 

-  and  Pace. 


□  Intensified  interactivity. 


Enter  the  Computer: 

A  Third  Revolution  in  Learning? 


•  Writing 

Content  of  learning  made  available  anytime,  anywhere 

•  Books 

Affordable  content  of  learning  made  available  anytime, 
anywhere 

•  Technology 

Affordable  content  and  interactions  of  learning  made 
available  anytime,  anywhere 


A  DARPA  Challenge 


16  weeks  of  simulation-based,  “intelligent” 
training  to  produce  graduates  who  are  superior  to 
technicians  with  7  years  of  IT  experience 

in  the  Fleet. 


Cognitive  models  have  been  used  in 
technology-based  instruction  from  the 
beginning. 


An  Intrinsic  Cognitive  Model:  Keller’s  PSI 


Keller’s  Personalized  System  of  Instruction  (PSI) 

Modularized  Instruction 


Pre-Test  -►  Diagnose  &  Assess  -►  Study  Guide  -►  Post-test 


c 


Another  Intrinsic  Cognitive  Model: 
Crowder’s  Intrinsic  Programming 


In  the  multiplication  3X4  =  12, 
the  number  12  is  called  a _ . 

A.  Factor  [Branch  to  remedial 
XI] 

B.  Quotient  [Branch  to  remedial  X2] 

C.  Product  [Reinforce,  go  to  next] 

D.  Power  [Branch  to  remedial  X3] 


PSI  (Keller)  with 

Intrinsic  Programming  (Crowder) 


Yes,  on  to  the  next  module 

- ► 


In  the  multiplication  3X4  =  12, 
the  number  12  is  called  a _ . 

A.  Factor  [Branch  to  remedial 
XI] 

B.  Quotient  [Branch  to  remedial  X2] 

C.  Product  [Reinforce,  go  to  next] 

D.  Power  [Branch  to  remedial  X3] 

- Post-test 


From  previous  module  Pr£i 

re- 

Pass? 


No,  go  to  this  module  I 


Selecting  an  Item/Problem  to  Present  Next 

Some  Models  of  Memory 
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Allocating  Time  Among  Students 
Fun  with  Regression  Equations 


Linear: 

E(Oj)  =  b0  +  bjPj  +  b2Tj 

Linear  with  interaction: 

E(Oj)  =  b0  +  b|  Pj  +  b2Tj  +  b3  PjTj 

Cobb-Douglas: 

E(ln  Oj)  =  b0  +  b2  InPj  +  b2  lnTj 
Exponential: 

E(ln  Oj)  =  b0  +  b,  InPj  +  b2  lnT,  +  b3  (InTj  )2  +  b4  (lnl\)3 


(O  =  outcome;  P  =  pretreatment  measure;  T  =  time) 


•  • 


Does  it  Work?  The  “Rule  of  Thirds” 
(A  Statistical  Summary) 


Use  of  Technology-Based  Instruction  (adaptive  and 
distributable)  can  reduce  costs  of  instruction  by 

about  1/3,  and 

Either  increase  learning  by  about  1/3 

(Education) 

Or  reduce  time  to  learn  by  about  1/3 

(Training) 

N.B.:  The  real  payoff  is  increased 
effectiveness  and  productivity 


Simulation  in  the  Small: 
Simulation  Meets  Cognitive  Modeling 

(and  Vice  Versa) 


Tracking  the  Student  (“Stealth  Assessment”) 


Student:  What  is  the  base  emitter  voltage  of  t  he  voltage 
limiting  transistor? 

SOPHIE:  The  base  emitter  voltage  of  Q5  is  -.037  volts. 
Student:  What  about  for  the  current  limiting  transistor? 
SOPHIE:  The  base  emitter  voltage  of  Q8  is  .349  volts. 

Student:  What  should  it  be? 

SOPHIE:  In  a  working  circuit,  the  base  emitter  voltage  of  Q8 
is  .593  volts. 

Student:  Replace  Q8. 

SOPHIE:  I  am  going  to  ask  you  some  questions  about  how  Q8 
is  faulted.  Are  any  junctions  shorted? 

(From  Brown,  Burton,  &  DeKleer,  1982) 


Some  Early  ICAI/ITS  Systems 


South  American  geography 
Causes  of  rainfall 
Symbolic  integration 
Electronic  troubleshooting 
Arithmetic  expressions 
Subtraction 
Logical  relations 
Logic  and  set  theory 
BASIC  programming 
LOGO  programming 
Algebra  word  problems 
Algebraic  procedures 
Quadratic  equations 
Infectious  diseases 
PASCAL  programming 
Steam  propulsion  (USN) 


Carbonell,  1970 
Stevens,  et  al.,  1982 
Kimball,  1982 
Brown,  et  al.,  1982 
Burton  &  Brown,  1979 
Brown  &  Burton,  1978 
Goldstein,  1982 
Suppes,  1982 
Barr,  et  al.,  1976 
Miller,  1982 
Lantz,  et  al.,  1983 
Sleeman,  1982 
O’Shea,  1982 _ 

Clancey,  1982 
Soloway,  et  al.,  1983 
Williams,  et  al.,  1981 


Simulation  in  the  Small:  DIAG  Example 


A  Rotary  Dial  with  Detents 


Flash  Object 
86  program  statements 
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Re  Act  Object 
1  program  statement 


aecw  ON 
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OFF 


AECMStndby 


Simulation  in  the  Large: 
Preparing  for  Incredibly  Complex  Tasks 


"Top  Gun"  Example 


Air-to-Air 

Loss/Exchange 

Ratio 


1965-1968 


1969 


1970-1973 


What  Was  Different? 


[ 


Before  Top  Gun 

No  instrumentation 
Untrained  OpFor 
Umpires 

Classroom  Tactics 
Tests 


With  Top  Gun 

Instrumentation 
Trained  OpFor 
Force  on  Force 
Practice  in  the  Sky 
"Situated"  Assessment 


From 

REALTRAIN 

to 

MILES  (Multiple  Integrated  Laser  Engagement 

Simulation) 

to 

Simulation  Networks 

to 

Irregular  Warfare  Training 


Simulation  for  Irregular  Warfare 


What  Value  Do  Cognitive  Models  Bring 
to  Simulation  in  the  Large? 


Training  for  an  Incredibly  Complex  Task: 

An  IMAT  Display 


Incredibly  Complex  Tasks 


Abstract 

Physical  phenomena  or  causation  are  not  readily  visible 

Multivariate 

Many  variables  underlie  outcomes. 

Interactive 

Changes  in  one  variable  may  affect  several  others. 

Processes  are  co-dependent. 

Continuous 

Physical  phenomena  and  their  effects  are  described 
as  values  along  continua,  rather  than  as  discrete  properties. 

Non-Linear 

Relations  among  variables  are  not  simple  straight-line 
functions 

Dynamic 

The  process  of  variation  is  of  interest,  rather  than  end-state 

Simultaneous 

Systemic  variation  is  coincident  rather  than  serial. 

Conditional 

Outcomes  are  highly  dependent  on  boundary  conditions 
and  context. 

Uncertain 

Exact  values  of  underlying  variables  are  not  known 
precisely  -  they  may  be  estimates,  interpolations, 
approximations 

Ambiguous 

The  same  outcome  may  arise  from  different  combinations  of 
inputs. 

Preparing  for  the  Unexpected: 
Cognitive  Readiness 


Cognitive  readiness  is  the  mental  preparation 
(including  skills,  knowledge,  abilities, 
motivations,  and  personal  dispositions)  an 
individual  needs  to  establish  and  sustain 
competent  performance  in  the  complex  and 
unpredictable  environment  of  modern 
military  operations. 


Some  Open  Questions 


•  Do  we  need  cognitive  models  in  simulation  in  the  large? 

•  What  might  be  their  value  of  cognitive  models?  (Design, 
development,  implementation  (AARs),  assessment) 

•  From  METLs  to  MECs  -  how  do  we  prepare  people  for 
the  unexpected  -  cognitive  readiness? 

•  Cognitive  models  for  teams? 

•  What  are  the  psychometric  characteristics  of 
simulations  (reliable,  valid,  precise)? 


Some  Cognitive  Models 


•  Atomic  Components  of  Thought  (ACT)  &  Atomic  Components  of  Thought  - 
Rational  (ACT-R)) 

•  Adaptive  Resonance  Theory  (ART) 

•  Architecture  for  Procedure  Execution  (APEX) 

•  Business  Redesign  Agent-Based  Holistic  Modeling  System  (Brahms) 

•  Cognition  and  Affect  Project  (CogAff) 

•  Cognition  as  a  Network  Of  Tasks  (COGNET) 

•  Cognitive  Complexity  Theory  (CCT) 

•  Cognitive  Objects  within  a  Graphical  EnviroNmentT  (COGENT) 

•  Concurrent  Activation-Based  Production  System  (CAPS) 

•  Construction-Integration  Theory  (C-l  Theory) 

•  Distributed  Cognition  (DCOG) 

•  Executive  Process/Interactive  Control  (EPIC) 

•  Human  Operator  Simulator  (HOS) 

•  Man-machine  Integrated  Design  and  Analysis  System  (MIDAS) 

•  Micro  Systems  Analysis  Of  Integrated  Network  Of  Tasks  (Micro  Saint) 

•  Operator  Model  Architecture  (OMAR) 

•  PSI 

•  Situation  Awareness  Model  for  Pilot-in-the-Loop  Evaluation  (SAMPLE) 

•  State,  Operator,  And  Result  (SOAR) 


In  Conclusion ... 


•  Cognitive  models  are  an  instructional 
imperative  ...  and  no  longer  an  economic 
impossibility. 

•  Cognitive  models  have  been  used  in 
technology-based  instruction  from  the 
beginning. 

•  Cognitive  models  are  needed  for  simulation 
used  to  train.  Open  questions  remain. 


